# Multiple Quantization Versions
Qwen2 Audio 7B Instruct GGUF
Apache-2.0
Static quantized version of Qwen2-Audio-7B-Instruct model, supporting English audio-to-text conversion tasks
Audio-to-Text
Transformers English

Q
mradermacher
146
0
Josiefied Qwen3 4B Abliterated V1 Gguf
Apache-2.0
This is the GGUF quantized version of the Josiefied-Qwen3-4B-abliterated-v1 model, suitable for local deployment and execution.
Large Language Model
J
Goekdeniz-Guelmez
4,518
7
Deepcoder 14B Preview Exl2
DeepCoder-14B-Preview is a code generation model developed based on DeepSeek-R1-Distill-Qwen-14B, focusing on solving verifiable programming problems.
Large Language Model English
D
cgus
46
2
Beaver 7b V3.0 GGUF
Beaver-7B-v3.0 is a 7B-parameter large language model based on the LLaMA architecture, focusing on safety and human feedback reinforcement learning (RLHF).
Large Language Model English
B
mradermacher
405
1
Orpheus Bangla GGUF
Apache-2.0
This is the static quantized version of the asif00/orpheus-bangla-tts model, supporting Bengali text-to-speech tasks.
Speech Synthesis Other
O
mradermacher
416
0
Lightblue Reranker 0.5 Bincont Filt Gguf
This is a text ranking model used for sorting text by relevance.
Text Embedding
L
RichardErkhov
2,054
0
Lightblue Reranker 0.5 Cont Gguf
This is a text ranking model used for reordering and scoring texts.
Text Embedding
L
RichardErkhov
1,986
0
Jbaron34 Qwen2.5 0.5b Bebop Reranker Newer Small Gguf
A 50-million-parameter text reranking model based on the Qwen2.5 architecture, suitable for information retrieval and document ranking tasks
Large Language Model
J
RichardErkhov
2,117
0
Jbaron34 Qwen2.5 0.5b Bebop Reranker New Small Gguf
A text reranking model based on the Qwen2.5 architecture with 0.5B parameters, suitable for reranking tasks.
Large Language Model
J
RichardErkhov
2,454
0
Greek Text Summarization GGUF
Apache-2.0
Static quantized version based on kriton/greek-text-summarization, specialized for Greek text summarization tasks
Text Generation Other
G
mradermacher
216
0
Smolmaestra 1.7b Translation GGUF
Apache-2.0
SmolMaestra-1.7b-Translation is a 1.7B parameter translation model that supports translation tasks between English and Italian.
Machine Translation Supports Multiple Languages
S
tensorblock
406
1
FLUX.1 Canny Dev GGUF
Other
FLUX.1-Canny-dev is a text-to-image generation model focused on image generation tasks.
Text-to-Image English
F
second-state
676
12
Stable Diffusion 3.5 Medium GGUF
Other
GGUF quantized version of Stable Diffusion 3.5 Medium, supporting text-to-image generation tasks.
Text-to-Image English
S
second-state
3,333
8
Llama Mesh GGUF
LLaMA-Mesh is a text-to-3D model based on the LLaMA architecture, focusing on mesh generation tasks. This version is quantized using llama.cpp, offering multiple quantization options to suit different hardware requirements.
Text-to-Image
L
bartowski
1,911
30
FLUX.1 Dev GGUF
Other
FLUX.1-dev is a text-to-image diffusion model developed by black-forest-labs, capable of generating high-quality images from text prompts.
Text-to-Image English
F
second-state
2,211
8
Thusinh1969 Gemma2 2b Rerank Checkpoint 8800 Gguf
Text ranking model based on Gemma 2B architecture, offering multiple quantization versions to suit different hardware needs
T
RichardErkhov
71
0
Mistral 7B Instruct V0.3 GGUF
Apache-2.0
Mistral-7B-Instruct-v0.3 is a large language model based on Mistral-7B-v0.3 with instruction fine-tuning, supporting function calling and an expanded vocabulary.
Large Language Model
M
SanctumAI
34.61k
9
Phi 3 Mini 128k Instruct Function GGUF
Phi-3-mini-128k-instruct_function is a text generation model based on GGUF format quantization, supporting multiple quantization levels.
Large Language Model
P
afrideva
40
1
Featured Recommended AI Models